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Abstract 

Network calculus is an elegant theory which uses envelopes to determine the 
worst-case performance bounds in a network. Statistical network calculus 
is the probabilistic version of network calculus, which strives to retain the 
simplicity of envelope approach from network calculus and use the arguments 
of statistical multiplexing to determine probabilistic performance bounds in 
a network. One of the key results of deterministic network calculus is that 
the end-to-end performance measures determined using a network service 
envelope is bounded by 0{H), where H is the number of nodes traversed by 
a flow. There have been many attempts to achieve a similar linear scaling 
of probabilistic performance bounds in statistical network calculus but with 
limited success. The main contribution of this paper is to establish an end- 
to-end stochastic network calculus with the notion of effective bandwidth 
and effective capacity from large deviations theory which provides end-to- 
end delay and backlog bounds that grows linearly in the number of nodes 
(H) traversed by the arrival traffic, under relatively general assumptions. 

Keywords: Stochastic Network Calculus, Network Service Envelope, QoS, 
Effective Bandwidth, Effective Capacity 



1. Introduction 

The increasing share of real-time traffic (IPTV, VoIP, Internet Radio, 
etc.,) over the Internet has motivated the study of Quality of Service (QoS) 
guarantees in data networks. The key aspect of guaranteeing QoS in a data 
network is to be able to efficiently model the arrival traffic and the service 
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offered by the network. There exist many network theories which facihtate 
the modehng of traffic and service in data networks. Network calculus is 
one of the popular theories in recent times useful for the performance analy- 
sis of data networks. Network calculus uses deterministic arrival and service 
envelopes to bound traffic arrivals and the service offered at the nodes, respec- 
tively, to compute the worst case end-to-end performance bounds. However, 
most of the multimedia traffic observed in the Internet can tolerate some vi- 
olation in its QoS requirements, and moreover, the statistical multiplexing in 
data networks smoothens the burstiness of the aggregate arrival traffic with 
high probability. Therefore the theory of network calculus was extended to 
the probabilistic domain, especially to benefit from the statistical multiplex- 
ing in data networks. The probabilistic version of network calculus is called 
statistical network calculus and it strives to retain many of the favorable 
characteristics of the network calculus, especially the simple envelope ap- 
proach to derive probabilistic bounds. The raison d'etre of network calculus 
is the possibility to model a network of nodes as a single abstract node using 
a network service envelope. In [ij, authors have shown that the end-to-end 
worst-case performance measures obtained by summing the per-hop results 
are bounded by 0{H^), while the end-to-end bounds obtained using network 
service envelope scales linearly in the number of nodes H connected in series. 
There have been many attempts to achieve similar linear scaling of end- 
to-end probabilistic performance bounds in statistical network calculus but 
with limited success. Most of these attempts use network service envelope 
with conservative envelope definitions j2| or with some mathematical exten- 
sions like, rate correction factor jsf, delay threshold, busy period bounds 0], 
time-domain extensions jsj. Most notably, in jsl authors employed network 
service envelope with rate correction factor to compute the end-to-end per- 
formance measures that scales as 0{H log H). In [oj, authors have shown 
using stochastic network calculus with moment generating functions that, if 
the arrival traffic and the service offered at each network node are indepen- 
dent of one another, the end-to-end performance bounds can scale linearly, 
i.e.,C(i/). We direct the interested readers to the corresponding papers and 
to for an elaborate discussion on what makes statistical network calculus 
so difficult. 



^The terms statistical network calculus, stochastic network calculus and probabilistic 
network calculus are used interchangeably in the literature 



2 



Figure 1: Network of H concatenated nodes 

Until now it has not been proven that the end-to-end probabihstic per- 
formance bounds computed using network calculus can actually scale as well 
as deterministic bounds. Based on the notion of effective bandwidth Q and 
effective capacity from large deviations theory, we develop an end-to-end 
stochastic network calculus which achieves the linear scaling of end-to-end 
performance measures without requiring any additional assumptions beyond 
the existence of effective bandwidth and effective capacity of arrival and ser- 
vice processes, respectively, and the stationarity of processes. 

The rest of the paper is structured as follows: Section [2] introduces the ar- 
rival and service model used in the paper. In Section [3], we derive end-to-end 
backlog and delay bounds using stochastic network calculus with effective 
bandwidth and effective capacity functions. In Section HI a numerical ex- 
ample using Markov Modulated On-Off traffic is presented for illustration. 
Brief conclusions are presented in Section O 



2. Arrival and Service Models 

In this section, we give a brief overview of the arrival and service models 
employed in this paper. Throughout this paper, we use a discrete time model 
t G No = {0, 1,2,.. .}. We consider a network of H nodes connected in series 
as shown in Fig. [T], with each node in the network having infinite-sized 
buffer serves the arrival traffic in a work-conserving fashion. Let the arrival 
and departure processes at a network node h are modeled with bivariate 
real- valued left-continuous processes Ah{s, t) and Dh{s, t), respectively, which 
represents the cumulative amount of data seen in the interval (s, t] for any 
< s < t. Let the service offered at hop h for h = 1, . . . , H is characterized 
using a bivariate real-valued left-continuous process Sh{s, t), which represents 
the cumulative amount of data served at the node in the interval (s, t] for any 
< s < t. To simplify the notation, we denote Ah{0,t) = Ah{t), Dh{0,t) = 
Dh(t), Sh{0,t) = Sfi{h) for any t > 0. We assume that the network is causal, 
i.e., Ah{t) < Dh{t) at any hop h in the network for any t > 0, and there are 
no arrivals in the interval (— cxd,0]. For an arrival process A^ at a network 
node h, whose offered service is characterized by a stochastic service process 
Sh, the corresponding departure process Dh satisfies for any fixed sample 



3 



path and all t > 0: 

Ah^Sh{t)<Df,it) (1) 

where ® denotes the {min, +) convolution of Ah and Sh which is defined as 
Ah ® Sh{t) = info<s<t{^h(0, s) + Sh{s, t)}. Any random process S satisfying 
the above relationship (equation ([T])) between arrival process and departure 
process for any fixed sample path is referred to as "dynamic F-server" [9|. 

Let A = Ai he the arrival traffic at the node 1 or ingress of the network 
and D = Dh = Ah+i represent the departure traffic from the node H or 
egress of the network as shown in Fig. [H The departure traffic Dh from the 
node at hop h becomes the arrival traffic Ah+i to the downstream node at 
hop h + 1, i.e., Ah+i = Dh for all h = 1, . . . , H. Since we assume the arrival 
and the service processes at each hop to be stationary, i.e., arrival and service 
processes depends only on the length of the interval (s, t]{A = t — s) , but not 
on s or t itself, the arrival and the service processes for any < s < t can be 
written as A{s,t) = A{A) and Sh{s,t) = Sh{A), respectively. In~p. [gI. [io| . 
authors show that the stochastic network service process Smt describing the 
service offered in network of H nodes connected in series, with stochastic 
service process Sh for h = 1, . . . ,H characterizing the corresponding service 
offered at hop h, for any fixed sample path is given by 

Snet = Si0 S2®---0 Sh (2) 

To derive probabilistic performance measures using the stochastic arrival 
and service processes, one needs non-random functions characterizing the 
arrival and service processes. In [6] , authors used moment generating function 
of the arrival traffic and conjugate moment generating function of the service 
process to derive the performance measures in a network. Here we adopt the 
popular notions of effective bandwidth (ah) 0] and effective capacity {f3h) jsl 
from large deviations theory to describe the stochastic arrival process and 
the service process characterizing the service offered at a network node h, 
respectively. The effective bandwidth of an arrival traffic Ah from for all 
6,t > 0, is given as 

a.(^,t) = ilogi?[e^-^'^W] (3) 

Similarly, the effective capacity function of a stochastic service process Sh at 
a node h from [s^, for all 6*, t > 0, is defined as 

MO,t) = -UogE[e-'''^^'^] (4) 
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3. Stochastic Network Calculus with Effective Bandwidth and Ef- 
fective Capacity 

In this section we apply the arrival and service models from Section [2] 
to derive end-to-end performance bounds using stochastic network calculus 
with effective bandwidth and effective capacity. The fundamental difference 
between the statistical network calculus and its deterministic counterpart 
is that the performance bounds are expressed as probabilistic tail bounds, 
i.e., the derived bounds are violated with some probability. The end-to- 
end backlog B and delay W processes at time t in network of H nodes 
connected in series as shown in Fig. [T] are given by B{t) = A{t) — D{t) 
and W{t) = inf {(i > : A{t — d) < D{t)}, respectively. In The following we 
derive the probabilistic bound on the end-to-end backlog and delay using 
stochastic network calculus with effective bandwidth and effective capacity 
functions. It should be noted that no assumptions on the independence of 
arrival and service processes were made. 

Theorem 3.1. Let A be the arrival traffic to a network of H nodes connected 
in series with effective bandwidth function a and D be the departure traffic 
from the network. Assume Sh for h = 1,...,H be the stochastic service 
process at each hop in a network of H nodes with their corresponding effective 
capacity j3h- Then we have the following probabilistic bounds. 

1. Backlog bound : The probabilistic bound on the backlog in a network is 
given, for all t > 0, by 



2. Delay bound : The probabilistic bound on the delay in a network is 
given, for all t > 0, by 






((uH-d)a(0,UH-d)-UHl3H{6,UH)) 
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Proof: We now prove the probabilistic bound on backlog B. For any t > 0, 
we have 

P {B{t) >x}^P {A{t) - D{t) >x}<P {A{t) -A® Snet(t) > x} 
= P{A(t)-A®Si®---®SH(t)>x} 

= P i sup {A{t) - A{0, /ci) - 5i ® ■ • • ® Sffih, t)}>x\ 
= P| sup {A{ki,t)-{Si{h,k2) 

L0<fcl<fe2<fe3<-<feif<t 

+S2{k2, /cs) + • • • + Snikn, t)}} > x} 

< P\ sup {A(h,k2)-Si(ki,k2)} 

L0<fel<fe2<t 

+ sup {A{k2,k3)-S2{k2,k3)} + --- 

0<k2<k3<t 

+ sup {A{kH,t) - SHikH,t)} > x\ 

0<kH<t J 

< E e®^"P°^'^l^'^2<«{^('^l''=2)-S'l(fcl,fe2)}+SUPo<fc2<fc3<t{-4(fe2,fe3)-S2(fe2,fe3)} _|_ . . . 

g0supo<fc^<aA(feff,t)-5ff(feff,t)}j g-Gx 

^11-^ |^e-'^0supo<„.<t{AK)-5iK)}j 



i=l 
H / t 



^ n I] ^ [gi/0{AK)-s,K)}j g-eo. 

i=l \ui=0 J 
H / t 

1=1 \ui=0 / 



0X 



H / t \^ 



Yl /-^(<yie,ui)-Me,ui)) 

i=l \ui=0 



The proof of the probabilistic bound on delay W follows the similar steps. 

For any t > 0, wc have 

P {W{t) >d} = P {A{t -d)- D{t) > 0} < P {A{t -d)-A® Snet{t) > 0} 
= P{A{t-d)-A^Si^---®SH{t)>0} 
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P < sup {A{t - d) - A{0, ki) - ^1 

yd<ki<t 



p 



sup 

d<ki<k2<k3<-<kH<t 



■■(»SHiki,t)} >0 

{A(k,,t-d)-{S,ik,,k2) 



+ S2{k2,k3) + ■ ■ ■ + SH{kH,t)}} > 0} 



< P{ sup {A{k,,k2)-Si{ki,k2)} 

^0<ki<k2<t 

+ sup {A{k2,k3) - S2{k2,k3)} + 

0<k2<k3<t 



+ sup {A{kH,t - d) - SHikH,t)} > 

d<kH<t 



< E 



g©SUPo<fci<fc2<t{^('=l.'=2)-5'i(fci,fc2)}+SUPo<j.2<fc3<t{^(fc2,A:3)-52(fc2,A:3)} _^ . . . 

g0sup^<fe^<({A(fe^,t-d)-5H(fcH,t)} 



H-l 

4=1 

//-I / t 



_H"0supo< <t{A(uj)-5j(uj)} 



if 



7? / t 



l_ 

H 



< 



n 

4=1 \jli=0 



He{A(u,)-S,{u,)} 



UH=d 



H 



i=l \ni=0 

t 



if 



\Uff=d 



H-l / t 

HE' 

j=i W=o 



H 



J_ 

H 



,i^(a(0,n,)-ft(e,n,)) 



^^{uH-d)a(9,UH-d)-UHPH{e,UH)) 



The inequalities in the respective proofs for probabihstic backlog and delay 
bounds follow the similar reasons. The first inequality is from the property 
of stochastic network service process (equation ([1])). The second inequality 
is due to the property of supremum operation, i.e., supo<s<t{^(s) + Y{s)} < 
suPq<^<^{X(s)} + supQ<g<j{y(s)} [2]. The third and fourth inequalities are 
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from Chernoff 's bouncH and Holder's inequalitjH, respectively. Application 
of Boole's inequality leads to the fifth inequality. The sixth inequality is due 
to the application of Schwarz's lnequalit}0. The final step is obtained by 
setting 9 = 2HQ and from the definition of effective bandwidth and effective 
capacity. Minimizing the expression over 9 proves our claim on probabilistic 
backlog and delay bound. ■ 

Since the use of Holder's inequality can be avoided for the independent ran- 
dom variable^, the performance bounds from Theorem 13.11 can be further 
improved if the arrival traffic process A and the stochastic service process 
Sh at each hop h for h = 1,2, . . . , H are statistically independent of one an- 
other and has been analyzed using statistical network calculus with moment 
generating functions in j6|. 

To analyze the linear scaling of end-to-end probabilistic performance 
bounds from Theorem 13.11 we consider a tandem network of H nodes con- 
nected in series as shown in Fig. [H with each node offering similar service 
characterized by the stochastic service process S with the corresponding ef- 
fective capacity {3. Then the probabilistic backlog and delay bounds from 
Theorem 13. Ij for any t > 0, will become 

P{B{t)>x} < 
P{W{t)>d} < 



If the probabilistic backlog and delay bounds are violated at most with the 
probability e, then setting the bounds on the right-hand sides of equations 



^For random variable X and x,e>0, P{X > x} < E[e^^]e-'^^. 

3For random variables X,y and a, 6 > with 1/a + l/fe = 1, E[XY] < E[X''\^ E[Y^\t: . 

^For random variables X,Y, E[XY] < E[X^]i E[Y'^]i . 

^For any two independent random variables X, Y, E[XY] = E[X]E[Y] 



jf-i 

H 



t 



(7) 



vJi=0 



y{e,u-d)-ul3H(d,u)) 



(8) 
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Figure 2: Network of H concatenated nodes with cross traffic 
([7]) and ([8]) to e and solving for x and d gives 



X > 



2H 



log- (^ei 

\m=0 



(9) 



t 

KU=d / \u=0 



%i(a(e,n)-/3(e,n)) 



- log I 5^ j > (i/ - 1) log I ^ e- 

-Hloge (10) 



It is apparent from equations Qj and ffTOj) that the end-to-end backlog and 
delay bounds using Theorem 13.11 grows linearly in the number of nodes H 
a flow traverses in a network. The significance of the presented approach is 
that the stochastic information about the arrival and service processes are 
retained as long as possible using the concept of effective bandwidth and 
effective capacity, respectively, which allows the computation of end-to-end 
stochastic performance measures that grows linearly in the number of nodes 
H traversed by the arrival traffic, whereas in other approaches as in j2[ 0, 0, [sf 
the stochastic information about the arrival and service processes are lost as 
soon as statistical envelopes are fixed. 

4. Numerical Example 

In this section, we illustrate the benefits of end-to-end stochastic network 
calculus with effective bandwidth and effective capacity using the arrival 
traffic modeled as Markov modulated on-off (MMOO) process, especially 
we show that the end-to-end performance bounds computed using Theorem 
13.11 are as good as the ones obtain using statistical envelopes |3| and also 
scales linearly in the number of nodes H. Markov modulated on-off process 
is commonly used to model voice 11 1 and video traffic in the Internet. 



Markov modulated on-off process can be in '"On"' state or '"Off" state 
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for random time intervals which are negative exponentially distributed with 
averages E[Ton] and E[Toff], respectively. In '"On"' state, arrival traffic 
transmits data at a constant rate P and no data is transmitted in '"Off" 
state. The effective bandwidth of Markov modulated on-off process has an 
interesting property that a{6,t) < a{9) and for any ^ > is given by 

a{9) = 1 (^P^ - no - roi + \/ {P9 - no + roif + AnoVoi^ (11) 

^^^^^ = ^"""^ ""oi = mAtTI- 

For the analysis we consider a network of H nodes connected in series 

with cross traffic as shown in Fig. [2j The queue at each hop h is served in 

a work conserving fashion at a constant deterministic service rate C. The 

flow of interest is the one which traverses through the network of H nodes 

connected in series and is termed through flow A. The flow which transits 

the network at each hop is termed cross flow A^. Let a and etc be the 

effective bandwidth functions of the through flow A and the cross flow A^, 

respectively. Let there be independent through flows at the ingress of the 

network and M independent cross flows at each hop h inside the network. 

For alH > and any 9 > 0, the condition C > Na{9) + Mac{9) must be 

satisfied for stability. The service available to the through flows at hop h 

can be characterized using leftover stochastic service process Sh(t) = S(t) = 

Ct - MA^{t) with effective capacity function j3h{9) = (3{9) = C - Mac{9) 



under general scheduling model p, llO| for /i = 1, . . . , i7 and any t, 6* > 0. 



We evaluate the larger time interval [0, oo] instead of [0,t] to compute end- 
to-end, closed-form performance measures using Theorem 13.11 The backlog 
X and delay d bounds which are violated at most with probability e can be 
computed from equations ([9]) and (fTOj) using Theorem 13.11 for any t > and 

6^ > 0, as 



^log-ff;e^(^"( 

^ \m=0 



1H 1 
> inf — log^ ^ (12) 

e>o 9 ^ [i _ (>'^{C-Na{e)-Ma^{e)y 



^ 2 

KU=d / \u=0 



oo 

{Na{e)-m) 



log I et(("-'=')^"W-«/^W) ) > (// - 1) log I ^ e- 

-H\oge (13) 
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Figure 3: End-to-end delay bound for Markov modulated on-off traffic in a network of 
increasing number of nodes H with N — 781 through flows and M = 1953 cross flows at 
each hop 

and after some reordering of equation ( 1131) we obtain 



It is apparent from equations ( fT2l) and that the end-to-end backlog and 
delay bounds for MMOO traffic model using Theorem 13.11 grows linearly in 
the number of nodes H a flow traverses in a network. For the numerical 
experiment, we compute the end-to-end delay bound for through flows 
in the network with a violation probability e = 10~^. The capacity of the 
server C at each hop is set to 100Mbps and for each Markov modulated 
on-off process, we choose the following values which are typically used to 
model voice flows P = GAKbps, E[TJ = 0.4s and E[Toff] = 0.6s. The 
average arrival rate (m) of the Markov modulated on-off traffic using the 
given parameters is 25. QKbps. 

In Figs. |3] and HI the end-to-end delay bound computed using statistical 
envelope definitions from [sl] and delay bound from equation f|T^ are plot- 
ted. Fig. |3] shows the probabilistic end-to-end delay bound with a violation 
probability (e) of 10~^ as a function of increasing number of hops H. At 
each hop, = 781 through flows are multiplexed with M = 1953 indepen- 
dent cross flows. The plot validates the linear scaling of the end-to-end delay 



d > inf 




(14) 
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Figure 4: End-to-end statistical delay bounds for Markov modulated on-ofF traffic in a 
network of H nodes with a violation probability e — 10~^ 

bounds determined using Theorem 13.11 In Fig. |H we plot the probabihstic 
end-to-end delay bound for through flows in a network with H = 1, 2, 5, 10 
hops for increasing N + M number of flows at each hop while maintaining 
= M. It can be observed that the delay bound from equation ( IT^ yield 
a tighter delay bound than the ones computed using statistical envelopes 
even for single hop case. Though the difference between computed bound 
from equation and bound using statistical envelopes become small for 
H = 10, the gap becomes large when the number of nodes H traversed by 
the through flows is increased. 

5. Conclusion 

We presented an end-to-end stochastic network calculus with effective 
bandwidth and effective capacity functions. We then showed that such a 
formulation of network calculus results in end-to-end performance measures 
that grow linearly in the number of nodes traversed by the arrival traffic 
in a homogeneous network of nodes with each node offering similar service. 
Further we showed using numerical example with Markov modulated on-off 
arrivals traffic that the end-to-end delay bound computed using the presented 
stochastic network calculus is as good as the bounds obtained using statistical 
envelopes. 
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